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Principal  Investigators: 

Dr.  John  S.  Bay  (540)  231-5 1 14 

Dr.  Hugh  F.  VanLandingham  (540)  231-3297 

Cognizant  PNR  Program  Officer: 

Dr.  Teresa  McMullen 

Program  Objective: 

To  develop  methods  for  the  design  and  control  of  cooperative  multi-robotic  systems 
by  allowing  independent  intelligent  modules  to  self-organize  into  collaborative 
structures. 

RESULTS 

There  are  four  primary  results  of  the  first  year  of  the  project: 

•  It  was  discovered  that  clustering  algorithms  for  pre-sorting  high-dimensional 
datasets  was  not  effective  in  improving  subsequent  processing  by  reinforcement 
learning  methods.  It  had  been  hoped  that  pre-classification  would  better  facilitate 
data  processing  in  modular  systems. 

•  It  was  discovered  that  Bayesian  belief  networks  can  be  combined  with  decision 
nodes  and  an  incremental  assessment  algorithm  to  mimic  human  patterns  of  data 
reduction  and  knowledge  representation. 

•  The  human  immunological  system  was  identified  as  a  possible  model  for  a 
distributed  decision  network.  It  was  recently  discovered  that  this  system  works 
“bidirectionally”,  that  it,  with  model-based  and  data-driven  characteristics,  which 
we  believe  to  be  crucial  to  intelligent  behavior. 

•  Initial  work  has  identified  a  model-balancing  technique,  borrowed  from  linear 
system  theory,  that  is  a  strong  candidate  for  a  pruning  and  model  reduction  method 
for  large  modular  networks.  This  will  allow  us  to  avoid  over-  and  under-fitting  of 
observed  data. 

PLANS: 

For  the  coming  year  our  plans  are  to: 

•  Write  a  complete  multi-robot  exploration  and  learning  program  that  will  use  on-line 
sensory  data  to  evolve  a  cause/effect  model  of  the  robots’  environment  and  each 
robot’s  functional  relationship  with  the  other  robots.  Each  robot  will  generate  an 
adaptive  belief  network  that  it  will  later  use  to  guide  its  actions.  A  mobile  robot 
will  be  prepared  for  use  in  year  three  as  a  physical  testbed. 

•  Devise  analytical  methods  for  paring  a  large  belief  network  by  “balancing”  the 
nodes  so  that  each  proposition  can  be  compared  as  to  its  relative  importance. 
Propositions  that  have  little  influence  on  the  global  problem  will  be  pruned  in  order 
to  condense  experiential  data  into  more  general  concepts. 

•  Further  investigate  the  distributed  mechanisms  by  which  psychophysiological 
systems  perform  decision-making.  We  will  attempt  to  find  a  mathematical  or 


algorithmic  model  for  the  adaptation  that  occurs  due  to  immune  system  responses, 
and  how  these  adaptations  affect  behavior. 

GRADUATE  STUDENTS: 

Ferat  Sahin,  a  Ph.D.  student  from  Turkey. 

Hossam  Meshref,  a  Ph.D.  student  from  Egypt. 

Sarny  El  Shedied,  a  Ph.D.  student  from  Egypt. 

Yanhua  Chen,  an  M.S.  student  from  China  (who  has  recently  left  the  university  to  take 
industry  employment). 
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